Maximum entropy and minimum relative entropy in performance evaluation of digital communication syst - Communications, IEE Proceedings-
نویسنده
چکیده
The authors show that the Gaussquadrature rule (GQR) method, which is widely used in performance evaluation of digital communication systems, fails under certain frequently encountered conditions. The maximum entropy method (MEM), on the other hand, continues to give reliable results for most of these problems. In cases where the MEM becomes numerically unstable before it achieves sufficient accuracy the authors incorporate a prior estimate of the error probability distribution function (PDF) in a minimum relative entropy (MREM) algorithm in order to improve on the accuracy of their results. They compare the MEM and MREM results to those obtained with the GQR method for AWGN channels with single Rayleigh-path-faded BPSK signals to the P-branch diversity systems. In both cases the GQR method fails for large values of the SNR.
منابع مشابه
Maximum Entropy and the Method of Moments in Performance Evaluation of Digital Communications Systems
The maximum entropy criterion for estimating an unknown probability density function from its moments is applied to the evaluation of the average error probability in digital communications. Accurate averages are obtained, even when a few moments are available. The method is stable and results compare well with those from the powerful and widely used Gauss quadrature rules (GQR) method. For tes...
متن کاملObservational Modeling of the Kolmogorov-Sinai Entropy
In this paper, Kolmogorov-Sinai entropy is studied using mathematical modeling of an observer $ Theta $. The relative entropy of a sub-$ sigma_Theta $-algebra having finite atoms is defined and then the ergodic properties of relative semi-dynamical systems are investigated. Also, a relative version of Kolmogorov-Sinai theorem is given. Finally, it is proved that the relative entropy of a...
متن کاملA new hybrid method based on fuzzy Shannon’s Entropy and fuzzy COPRAS for CRM performance evaluation (Case: Mellat Bank)
Customer relationship management is a multiple perspective business paradigm which helps companies gaining competitive advantage through relationships with their customers. An integrated framework for evaluating CRM performance is an important issue which is not addressed completely in previous studies. The main purpose and the most important contribution of this study is introducing a framewor...
متن کاملComparison of entropy generation minimization principle and entransy theory in optimal design of thermal systems
In this study, the relationship among the concepts of entropy generation rate, entransy theory, and generalized thermal resistance to the optimal design of thermal systems is discussed. The equations of entropy and entransy rates are compared and their implications for optimization of conductive heat transfer are analyzed. The theoretical analyses show that based on entropy generation minimizat...
متن کاملSurvey and comparative analysis of entropy and relative entropy thresholding techniques
Entropy-based image thresholding has received considerable interest in recent years. Two types of entropy are generally used as thresholding criteria: Shannon’s entropy and relative entropy, also known as Kullback–Leibler information distance, where the former measures uncertainty in an information source with an optimal threshold obtained by maximising Shannon’s entropy, whereas the latter mea...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004